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Series expansion based on the flow equation method is employed to study the zero temperature 
properties of the spin— 1/2 J1-J2-J3 antiferromagnet in two dimensions. Starting from the exact 
limit of decoupled plaquettes in a particular generalized J1-J2-J3 model we analyze the evolution of 
the ground state energy and the elementary triplet excitations in powers of all three inter-plaquette 
couplings up to fifth order. We find the plaquette phase to remain stable over a wide range of 
exchange couplings and to connect adiabatically up to the case of the plain J1-J2-J3 model, however 
not to the J1-J2 model at J3 — 0. Besides confirming the existence of such a phase, recently predicted 
by Mambrini, et al. [Phys. Rev. B 74, 144422 (2006)], we estimate its extent by Dlog-Pade analysis 
of the critical lines that result from closure of the triplet gap. 
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INTRODUCTION 



The study of quasi two-dimensional (2D) materials 
with frustrated magnetic exchange interactions is a field 
of intense research. This research is driven by the quest 
for systems which may exhibit exotic magnetic phases 
instead of simple long range anti/ferromagnetic order 
(AFM/FMLRO) Q. Prominent examples of such phases 
are spin liquids (SL), with no ordering of any type, or va- 
lence bond states. The latter may occur as solids (VBS) 
with no breaking of lattice symmetries but potentially 
other hidden order, such as eg. string ordering, moreover 
valence bond crystals (VBC) are frequent, where lattice 
symmetries are directly broken in favor of eg. columnar 
or plaquette ordering P, [2, 0]. Even for simple frus- 
trated systems a quantitative understanding of the com- 
plete phase diagram is still lacking. The AFM spin- 1/2 
J1-J2 model on the square lattice, is a paradigmatic case 
in this respect. This model corresponds to FiglU for 
Ji = Jo > 0, J2 > and J3 = 0, where Ji (and Jo) is the 
nearest neighbor exchange interaction and frustration is 
induced by the next-nearest neighbor exchange interac- 
tion J2. Experimentally, Li2VOX04 (X = Ge, Si), which 
has been discovered recently, is a promising candidate to 
realize the J1-J2 model in the range J2/J1 ~ 5 — 10 [1,01. 
Two limiting cases of J1-J2 model are well-understood. 
For J2 = and Ji > 0, the system is the 2D Heisen- 
berg AFM, which exhibits Necl LRO. In the opposite 
limit, J1/J2 — > 0, the system turns into a set of two de- 
coupled AFMs on the 2D A and B sublattices. These 
lock into a coUinear state by the order-from-disorder ef- 
fect due to the finite J2. In the intermediate regime, 
0.4 « (J2/Ji)ci < J2/J1 < (J2/Ji)c2 ^ 0.6, both, the 
Neel and the collinear state are know to be unstable. 
Here, different approaches, including exact diagonaliza- 
tion (ED) 0,0, 11, quantum Monte Carlo (QMC) [1,1131, 



/ + y 



l + x + y 



2t 








1 


Hi 

^ ^ 




N ^ 


\ 


(- ^ 


^ 

^ ^ 


*7 






C — ^ 


ii> 

h ^> 



S=V2 



I 



l + x 



FIG. 1: The generalized J1-J2-J3 model considered in this 
work. Solid circles represent spin— 1/2 moments. Plaque- 
ttes (bold solid lines) are non- locally coupled by nearest (Ji), 
next nearest (J2) and next-next nearest (J3) interactions, rep- 
resented by thin solid, dashed and dot-dashed lines, respec- 
tively. For clarity only some of the J3 couplings are depicted. 
On each isolated plaquette, the couplings along the square 
edges are Jo (bold solid lines) and across the diagonals J2. 
At Ji = Jo the J1-J2-J3 model is recovered. Jo couplings are 
set to unity hereafter. 



spin wave theory (SW) [ill, la rge— N expansion [l3 l. and 



series expansion (SE) |l3l. 14. 15, l^, 12, 181, have con- 



firmed that one or several quantum disordered phases 
with a singlet ground state and a gap to magnetic exci- 
tations may be present. The precise nature of the inter- 
mediate phase (S), however, is still controversial. In the 
simplest scenario, considering the existence of a single 
intermediate phase only, a plaquette VBC [§1, a colum- 
nar VBC [l2l and a SL [I^l have been proposed. Other 
studies suggest that the intermediate phase could be com- 
posed of two SL-like phases [l^ . 

The main purpose of this paper is to put the J1-J2 



2 



model into a broader perspective, by considering an ex- 
tended version, i.e. the J1-J2-J3 model, which is de- 
picted in Fig[T]for Ji = Jq and includes a third nearest- 
neighbor interaction J3 (for clarity only some of the J3 
couplings are shown). Classically, the competing interac- 
tions J2/J1 and J3 / Ji lead to four ordered phases of the 
J1-J2-J3 model [iBili^, 21 1 . Among them, Neel and heli- 
coidal phases, which are separated by a classical critical 
line {J2 + 2J3) / Ji = 1/2 exist. The Neel phase remains 
rather stable against quantum fluctuations, although it 
has been conjectured that critical line, at J2 — 0, should 
be shifted to J3/J1 > 1/4 once the quantum model is 



considered [21 1 



The nature of the quantum phases in a selected region 
Ji , J2 , and J3 has been considered recently by Mam- 
brini et al. j22l |. By employing ED and diagonalization 
in a subset of short-range valence bond singlets (SRVB 
method) these authors have found evidence for a VBC 
ordered, gapped plaquette phase in an extended region 
around the hue {J2 -\- Jz) / Ji = 1/2 and J3 > J2. In 
this paper we will complement and extend these findings 
by performing SE analysis. In particular we will aim 
at a quantitative determination of the extension of the 
plaquette phase around the previously mentioned line by 
localizing the critical lines for a closure of the triplet gap. 

Our strategy will be to analyze perturbatively the evo- 
lution of the ground state of a generalized version of the 
J1-J2-J3 model. For this version Jq 7^ Ji- At Ji_3 = 
and J2 7^ only on those squares formed by the Jg-links 
the generalized J1-J2-J3 model shown in Fig[T] exhibits 
a product-state of disconnected bare four-spin 'plaque- 
ttes'. This will be the unperturbed ground state from 
which wc start. The local Jq couplings (bold lines) will 
be set to unity hereafter. Therefore at Ji = 1 we recover 
the J1-J2-J3 model (in units of Ji) from the generalized 
model. The Hamiltonian of generalized model is 

H = Ho + V; Ho^Y. '"-^X^ ^ = 51 (^i-' + ^2.1 + Vsa) , 
1 1 

(1) 

where /io,i refers to the local plaquette at site 1, given by 



^0,1 



[Si • S2 -f- S2 • S3 + S3 • S4 - 

+ J2(Si.S3 + S2-S4)]l 



S4 • Si 



(2) 



2^'^1234 ^^13 '^2 



^2(^13 + S24 - 3)]i, 



in which Si...„ = Si + . . . + S„. Vij, V2.1 and Vsj in 
Eq. ([1]) represent the inter-plaquette coupling at site 1 via 
nearest (Ji), next nearest (J2) and next-next nearest ( J3) 
interactions, respectively. 



^1,1 = >/l[S3,l • S2,l+x + S4,i • Sij+x 

+82,1 ■ Sij+y + S34 • S4j+y]; 

V2,l = >/2[S4,l • S2,l+x + S3J ■ Si,l+x 



(3) 
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TABLE L Eigenstates of a local plaquette Hamiltonian, /io,i- 
Each state is labeled by the energy: eq and the quantum 
numbers: S'1234, S13 and 524. Note that Jo coupling has been 
set to unity. 



+ 82,1 • S4,l + y + S3J • Sl,l + y 

+ 83,1 • Si,i+x+y + S4,l+y • S2,l+x] 



3,1 



4 
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Si,l+y) 



Table |T] shows the eigenstates of a local plaquette Hamil- 
tonian, /io,i, in which each state is labeled by the ground 
state energy: cq, the total spin: S'1234, and the spin along 
each diagonal: 6*13 and 6*24. 

From this table it follows that for < J2 < 1 the ground 
state is \St), i.e. a spin singlet along the plaquette and 
triplets along the diagonals. For < J2 < ^ the first ex- 
cited state is |7^), i.e. triplets along both the plaquette 
and the diagonals. At J2 = 1 there is a crossover in the 
ground state energy and thereafter the ground state is 
|iSs), i.e. singlets along the plaquette and the diagonals. 
The other states arc total triplets, \Tts) and con- 
sisting of a triplet on one of the diagonals and a triplet 
on the other one. Finally, there is a quintet state, \Qt)- 



SERIES EXPANSION BY CONTINUOUS 
UNITARY TRANSFORMATION 

In this Section we briefiy describe the SE expansion in 
terms of Ji, J2 and J3. First, we rewrite the Hamiltonian 
(Eq.©) as 

if = ifo(J2 = 0) + J2O0 + E U or), (4) 



i=l 



where Hq has been split into the first two terms. The first 
one, Ho{J2 = 0), has a set of equally spaced energy levels 
(Table IJ). These are labeled with a total particle-number 
operator: Q = J2i n{J2 = Q)- Q ~ corresponds to zero 
particle states: |0) = Hi \St)i- Q = 1 sector corresponds 
to one-particle states: |l)i' = I"?*)!' Ili^i^i' \^t)i, i-e., a 
local triplet at site 1' created from the vacuum. Q > 2 
sector of the spectrum is of multiparticle nature. 

The second term in Eq.([4|) refers to local contributions 
in Hq proportional to J2. The last three terms in the 
same Eq.Q represent the intcr-plaquettc interactions. 
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via Ji, J2 and J3, respectively. There, Of operators 
non-locally create (n > 0) and destroy (n < 0) quanta 
within the ladder spectrum of Hq{J2 — 0). The explicit 
tabulation of Of in this model shows that < 4 1231. 



It has been shown 2J] that models of type Eq.Q allow 
for SE by means of Wegner's continuous unitary trans- 
formation (CUT) method [2^. The basic idea is to map 
H — > i?offi where 



00 

E 

k.m.l — l 



jk T7n jl 



(5) 



The Ck.m,i operators in Eq.([5]) involve products of the 
Of operators of Eq.(|4]). However, as the main point and 
unlike in H , the effective Hamiltonian H^s is constructed 
to have a block diagonal structure, where each block has 
a fixed number of particles Q of Hq(J2 = 0). This is 
achieved order by order in the expansion. We refer to 
Ref. 2J] for further details. In the following Sections we 
will apply this technique to calculate the ground state 
energy and the one-particle excitations. 



DISPERSION OF ONE-TRIPLET EXCITATIONS 
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FIG. 2: Triplet dispersion toiyC) as a function of the wave 
vector k = ik^, ky) along the path k = (0, 0) — (tt, 0) — (tt, tt) — 
(0,0). Two families of curves in coupling-constant space with 
parametrization J2 = bJi and J3 = cJi close to the actual 
J1-J2-J3 model at Jl = 1 have been selected to show triplet 
softening, i.e. ^^^(k) = 0. The instability at kci = (0, 0) occurs 
at small values of J3, with respect to Ji (solid lines). For 
larger values of J3 the instability is at kc2 = (ti", tt) (dashed 
lines) . 



In this Section we evaluate the dispersion of one-triplet 
states for different values of the coupling constants, Ji, 
J2 and J3. To this end, it is necessary to diagonalize 
Hcff in the Q = 1 sector of Hq{J2 = 0), i.e., the subspace 
spanned by |l)i states. Q-conservation implies that the 
sole action of Hcs on the local triplet states refers to 
translation in real space, i.e.. 



Hcs\l) 



1 



ci|l) 



(6) 



where the ci's are the hopping amplitudes of a local 
triplet from origin to site 1. Due to the lattice trans- 
lational invariance Eq. ([6]) can be diagonalized by Fourier 
transformation 



Ei{k) = ^ciexp(ik- 1). 



(7) 



From this, the dispersion w(k) follows as 

u;(k) ^ E^ik) - Eo, (8) 

where the ground state energy, Eq, is obtained by ap- 
plying Q-conservation to the 0-particle sector, i.e., Eq = 
(O|i?off|0). It is important to note that, even without an 
explicit discussion of this quantity, Eq. ^ requires a full 
calculation of the ground state energy up to the same 
order as the hopping amplitudes. 

By symmetry considerations not all the ci's are inde- 
pendent, which leaves only a subset of them to be cal- 
culated. Usually, in CUT applications, the ci's at 0(n) 



are obtained in the thermodynamic limit, by consider- 
ing finite clusters which are large enough to embed all 
the paths of length n [2^ that connect origin with 
site I. In our model, due to the number of couplings 
considered and its dimensionality, this method becomes 
computationally very demanding. Alternatively, we have 
implemented a linked cluster approach, with subgraph 
subtraction to obtain the ci's. We refer to Ref. 27[ for 
technical details of this method. 

We have evaluated analytic expressions for the triplet 
dispersion, uj(k), keeping all three independent variables 
Jl, J2, a nd J3, i.e. without any parametrization, up to 
0(5) [23. 

Fig[2] shows the dispersion obtained at 0(5), as a func- 
tion of wave vector k, along high symmetry directions 
and for different values of the couplings. We have chosen 
paths in the couplings space that show the instabilities 
of the plaquette phase associated with triplet softening, 
i.e. ti'(k) = 0. We have selected two families of curves, 
parametrized according to Ji, J2 = 6J1, and J3 = cJi, 
around Ji = 1, the latter being the point where the Ji- 
J2-J3 model (in units of Ji) is recovered (see FiglT]). 

As shown in Figl^l triplet softening occurs at a criti- 
cal wave vector of kd = (0, 0) for the specific value of 
( Jl, J2, J3) « (1, 0.2, 0.12), i.e. for relatively small values 
of J3, as compared to J2 (solid lines). Additionally, for 
larger values of J3 a critical wave vector at kc2 = (tt, tt) 
(dashed lines) can be observed for the particular value 
of (Jl, J2, J3) « (1.1,0.15,0.76) (dashed line). We have 
found no other values for critical wave vectors. Fig[2]clar- 
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FIG. 3: Critical lines (aj(kc) — 0) in J1-J2 plane and J3 
as parameter. Triplet softening occurs at kci = (0, 0) and 
kc2 = (7r,7r), shown with solid and dashed lines, respectively. 
In all cases results from Dlog-Pade analysis are depicted. For 
< J3 < 0.4, the instability at kd limits the plaquette phase, 
projected onto Ji — J2 plane. But only for J3 > 0.05 a pla- 
quette phase appears in J1-J2-J3 model (critical lines cross 
Ji = 1). In particular, for Ji = 1, J2, and J3 = 0, i.e. 
in the J1-J2 model, the plaquette phase is not present. For 
0-7 ^ J3 ^ 0.8, the critical lines at kc2 limit the plaquette 
phase projected onto Ji — J2 plane. 



ifies the type of critical points that have to be expected 
and is a first indication of the qualitative relevance of J3 
on the possible ground states of the model. To obtain a 
quantitative picture, the stability region of the plaquette 
phase in J1-J2-J3 space will be studied in detail in the 
following Sections. 



STABILITY OF THE PLAQUETTE PHASE 

In this Section we discuss the quantum critical lines, 
resulting from the closure of the plaquette triplet gap, 
which resembles second order quantum phase transitions. 
This will give us a quantitative estimate of the stability 
region of the plaquette phase. In particular we are inter- 
ested in a possible adiabatic connection of the isolated 
bare plaquette phase (with only local J2 7^ 0) up to the 
value of Ji = 1. This analysis is shown in FigO which 
depicts the borders of the stability region projected onto 
Ji ~ J2 plane, taking J3 as parameter. 

Fig El displays two families of critical lines, correspond- 
ing to the closure of the triplet gap a;(kc) = for 
kci = (0, 0) and kc2 = (tt, tt), with dotted and solid lines, 
respectively. First, it is obvious that independently of 
J2 and J3 the plaquette phase extends from the origin, 
Ji = J2 ^ J3 = (not shown in Fig[3]) up to Ji « 0.55 
below which there are no signals of triplet softening. Sec- 
ond, we focus on the (X>(kci) — instability. In the case of 
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FIG. 4: Comparison between the triplet gap at kc = (0, 0) 
obtained by means of plain series and a particular Dlog-Pade 
approximant along selected straight line paths in couplings 
space, for a case in which the triplet gap closes at Ji = 1. 
Results from reintegrated Dlog-Pade(3,l), plain series at 0(4) 
and 0(5) are shown with solid, dot-dashed and dashed lines, 
respectively. For Ji < 0.5 the agreement is very good in 
all cases. Closer to J1-J2-J3 model, i.e. to Ji — 1, clear 
differences between the Dlog-Pade and the plain series arise. 



J3 = 0, as can be observed from the Figure, the critical 
line almost reaches, but does not cross the line Ji = 1. 
In other words: the J1-J2 model does not show a plaque- 
tte phase. This result is consistent with the previous SE 
analysis on J1-J2 model in Ref . [l^ . 

Third, we consider the simultaneous effect of Ji, J2 and 
J3. As can be observed in FiglJl increasing the values of 
J3 enlarges the region of stability of the plaquette phase 
in the Ji — J2 plane in terms of the critical line kd = (0, 0) 
(solid lines). Most important, finite J3 helps to stabilize 
the plaquette phase at Ji = 1. In fact, already for J3 « 
0.05 the critical line crosses Ji = 1. For J3 « 0.4 the 
solid critical line merges with the lower righthand corner 
of Fig[3] and the plaquette phase extends over all of the 
,/i — J2 plane shown. These results are consistent with 
Ref.0. 

Now we turn to the plaquette phase stability region, 
projected onto ,/i — J2 plane, limited by the critical lines 
cj(kc2) = (dotted lines in FiglSj. We find a similar 
tendency as for kc2, i.e. the region of stability of the pla- 
quette phase in the Ji — J2 plane is enlarged by increasing 
J3. In this case however the impact of J3 is somewhat 
less significant as compared to J2. 
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Technically, the critical lines of Figl3] have been ob- 
tained using Dlog-Pade analysis, rather than the plain 
series. This is known to improve the accuracy of locating 
the critical points significantly. For details on this tech- 
nique we refer the reader to the literature [2^. In order 
to work with single variable Dlog-Pades we have scanned 
the exchange coupling space by means of straight lines, 
parametrized according to (Ji, J2 = bJi, J3 = cJi). For 
fixed values of b and c this amounts to a single variable, 
i.e. Ji. 

To assess the impact of the Dlog-Pade analysis, we 
show its result for a;(kci), for a particular Dlog-Pade ap- 
proximant and a case in which the triplet gap closes at 
Ji = 1 (FigH]). A Similar analysis has been done for all 
the critical lines calculated, including several Dlog-Pade 
approximants in each case. In this Figure, the solid line 
refers to the reintegrated Dlog-Pade (3, 1), and the dot- 
dashed and dashed lines show the plain series at 0(4) and 
0(5), respectively. From there it is clear that for Ji < 0.5 
the agreement between the reintegrated Dlog-Pade and 
the SE at 0(4) and 0(5) is very good. In fact, all plots 
are indistinguishable on the scale used. This provides a 
qualitative measure of the convergence of the series. For 
■Ji ^ 0-5 and closer to criticality (at Ji = 1 in this case) 
however, we rely on the Dlog-Pade technique in order to 
describe the closure of the gap. 



PLAQUETTE PHASE AT Ji = 1 
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FIG. 5: Extension of the plaquette phase in J2 — J3 plane at 
Ji = 1 (actual J1-J2-J3 model). The lower and upper critical 
lines represent the closure of the triplet gap at kci = (0, 0) 
and kc2 = (t!", tt), respectively, which limit the plaquette phase 
(intermediate region labeled with P). Solid and dashed lines 
represent the results obtained employing Dlog-Pade approx- 
imants and plain series, respectively. The plaquette phase 
extends considerably around the straight line which connects 
(J2 = 0, J3 = 0.5) with (J2 J3,J3 « 0.25), previously 
studied in Ref . [2^ . Unlike the plain series, our Dlog-Pade 
analysis suggests that the plaquette phase is not present in 
J1-J2 model (J3 = 0) for the parameters studied. However, 
for 0.35 J2 < 0.6 the critical line is too close to J3 = to 
allow for definite statements at this order of SE. 



Here we analyze the extent of the plaquette phase on 
the J2-J3 plane at Ji = 1, i.e. for the actual J1-J2- 
J3 model, written in units of Ji. As it was mentioned 
in the Introduction, ED calculations for J1-J2-J3 model, 
using the complete Hilbert space and a restricted space 
of short-range dimer singlets, provide strong evidence for 
the existence of a plaquette phase around the line J2 + 
J3 = 1/2 at Ji = 1, in particular for J3 > J2 [111- In 
this Section, we will extend this study by specifying the 
extension of this phase as obtained from SE. To this end, 
we proceed as in the previous Section, i.e. the critical 
lines are obtained by analyzing the closure of the triplet 
gap, i.e. solutions of ^(k) = 0. 

In FigOwe show the corresponding results. The lower 
and upper critical lines mark the triplet softening at kd 
and kc2, respectively, and enclose the region of a finite 
triplet gap. I.e. this region refers to the plaquette phase, 
labeled by 'P'. In this Figure, Dlog-Pade approximants 
are depicted by solid lines, and the results obtained by 
employing the 0(5) plain series by dashed lines. We note 
that the critical lines shown from Dlog-Pade approxi- 
mants in FigOarc consistent with the pairs of (J2C, Jac) 
at Ji = 1 shown in FiglS] 

Although, as in the previous Section, we base our re- 
sults on the Dlog-Pade analysis, the agreement between 
the plain scries and the Dlog-Pade approximants can be 



used to assess the convergence of the series. From FiglH 
it is clear that the best agreement for the lower criti- 
cal line is found in the intermediate region, i.e where 
0-1 ^ J2,3 < 0.2. 

For the special case of J2 — 0, i.e. for the pure J1-J3 
model, it has been conjectured that the classical critical 
line to Ncel phase at J3/J1 = 0.25 (Ji = 1 in our case) 
should be shifted to larger values in the quantum model 
2ll | . For all Dlog-Pades analyzed, our results confirm this 
conjecture, as e.g. for the (3, 1) Dlog-Pade approximant 
of the lower critical line shown in FigO 

In conclusion we find that the plaquette phase extends 
considerably around the straight line of maximal frustra- 
tion, connecting J2 = 0, J3 = 0.5 with J2 = J3 — 0.25, 
which was studied in Ref. [22| . In particular, as it can be 
seen in Fig[5l the upper critical line is rather far from the 
line of maximal frustration. Additionally, in the limiting 
case J3 = 0, we remain with the J1-J2 model. For the 
latter, and as shown in the right lower corner of FiglSl 
and unlike the plain series, the Dlog-Pade analysis sug- 
gests that the critical line does not intersect the J2 axis. 
I.e. we find no stability of the plaquette phase. This is in 
agreement with the SE results of Ref. Yet, the prox- 
imity between the critical line and the J2 axis calls for 
caution on this finding with respect to the convergence 
of the SE in this parameter range. 
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CONCLUSIONS 

To summarize, using series expansion, based on flow 
equations we have analyzed the zero temperature prop- 
erties of the 2D spin-1/2 J1-J2-J3 AFM. Starting from 
the limit of decoupled plaquettes of a generalized J1-J2- 
J3 model wc have evaluated three-parameter series up 
to 0(5) in the interplaquctte exchange couplings Ji, J2 
and J3 for the ground state energy and for the triplet 
dispersion. 

We find a rather large range of Ji,2.3 couplings which 
adiabatically connects to the state of isolated plaque- 
ttes and hosts a plaquette phase which is stable against 
second order quantum phase transitions into magnetic 
states. Our findings corroborate and enhance related 
predictions of Mambrini et al. on the location of 

a stable plaquette phase at Ji = 1. 

For the particular case of the J1-J2 model at Jg = 0, 
and consistently with results obtained in Ref. IJ] , our 



calculation predicts that the plaquette phase is not sta- 
ble in the parameter range which we have investigated. 
However, higher order series expansions seem very de- 
sirable to render such results more reliable. In particu- 
lar, from our series we are reluctant to draw any definite 
conclusions about the controversial region J3 = and 
0-4 < J2 < 0.6. 

Finally, we emphasize that our analysis has been fo- 
cused on the stability of the plaquette phase with re- 
spect to second order transitions driven by one-particle 
(triplet) excitations. Further instabilities, like first order 
transitions or level crossings of excited states, other than 
elementary triplets, could give rise to further reduction 
of the plaquette regime and have not been considered 
here. Along this line, the two-particle sector, which in- 
cludes singlet excitations, may play a role that can be 
analyzed using our SE technique. This deserves future 
investigation. 
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